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Abstract 

These lecture notes provide an introduction to automorphism groups 
of graphs. Some special families of graphs are then discussed, espe- 
cially the families of Cayley graphs generated by transposition sets. 
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1 Introduction 

A permutation of a set Q is a bijection from Q to itself. For example, 
7T = (1,5, 4) (3, 6) (2) = (1,5, 4) (3, 6) = [5,2,6,1,4,3] is a permutation of 
{1, 2, 3, 4, 5, 6}. We can also write vr : 1 ^ 5, 2 ^ 2, 3 \-> 6, 4 H> 1, 5 H> 4, 6 H> 
3. The inverse of 7r is 7r _1 = (1, 4, 5)(3, 6)(2). Sym(fi) denotes the set of all 
permutations of Q. S n denotes the symmetric group Sym({l, . . . , n}. The 
composition of permutations is carried out left to right: (1, 2)(2, 3) = (1, 3, 2). 
A transposition r G S n is a permutation that interchanges two elements and 
fixes the remaining elements: r = (i,j). 

Let T := (V, E) be a simple, undirected graph. An automorphism of 
a graph is a permutation of the vertex set that preserves adjacency. The 
automorphism group of T is the set of permutations of the vertex set that 
preserve adjacency, i.e., Aut(T) := {n 6 Sym(V) : 7r(E) = E}. (Some of the 
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literature uses the notation E n = E instead of tt(E) = E.) Note that if tt is 
a bijection from V to iself, then tt induces a bijection on the 2-subsets of V , 
and so tt(E) and E have the same cardinality. So, if tt is an automorphism, 
then it necessarily must preserve non- adjacency as well. So, an equivalent 
definition is that: tt is an automorphism of F = (V,E) if for all u, v G V, 
u ~ v iff tx{u) ~ 7r(f ). Since the composition of two automorphisms is another 
automorphism, the set of automorphisms of a graph is a permutation group. 

The notation to use V rather than G for a graph is standard in algebraic 
graph theory. We shall use A to denote Aut(T). Later, we shall use G (and 
a subset S C G) to denote the group that generates a Cayley graph, i.e 
T = (V,E) = Cay (G,S), and we shall determine its automorphism group 
A := Aut(Cay(G, S)) for some families of (G, S). 

Example 1. The n-cycle. Let T be the graph on vertex set {1, . . . , n) hav- 
ing edge set E := {{1, 2}, {2, 3}, . . . , {n, 1}}. The rotation r = (1,2, ... ,n) is 
an automorphism of the graph, because r sends 1 to 2 and 2 to 3, hence {1, 2} 
to {2, 3}, and it is clear that E r = E. Let s be the permutation of V induced 
by the reflection of the n-cycle graph about the axis that passes through the 
vertex 1 and the center of the n-cycle. Thus, s = (1)(2, n)(3, n — 1) • • • . Note 
that (r, s) = D 2n , the dihedral group of order 2n. So D 2n < A := Aut(r). 
We now show that there are no other automorphisms. Let it G A. Suppose 
tt : 1 i — y i. Then it must send 2 to a neighbor of i, i.e. to % — 1 or i + 1. In 
the first case tt sends 3 to i — 2,4toi — 3, and so on. In the second case, tt 
sends 2 to i + 1 and hence 3 (a neighbor of 2) to a neighbor of i + 1, i.e. to i 
or i + 2, but 7r : 1 i— ?• i, so 3 h-» i + 2. In either case, 7r G D2 n - Thus A = Dm- 
I 

If 7r G Aut(r), then tt preserves adjacency and hence sends the neighbors 
of u to the neighbors of tt(u). So, if tt sends u to v, then u and v have the 
same degree (the same number of neighbors). 

One can similarly define the automorphism group of (X, S) for any struc- 
ture 5* on X. In the case of directed graphs, each element of S would be an 
ordered pair, and in case of edge-colored digraphs each element of 5* is an 
ordered triple. The automorphism group of (A, 5*) is the set of permutations 
tt in Sym(A) such that S w = S. 

We now introduce a definition [TT] : 

Definition 2. Let A < Sym(A), J B < Sym(F), with X and Y being dis- 
joint. Their sum (also known as the product or direct product) A + B is the 
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permutation group 



A + B := {(a,p) : a G A, f3 e B} 
acting on the disjoint union X U Y by the rule: 



(a,P)(z) 



a(z) if z E X 
(3(z) if z G Y. 



So A + B < Sym(X U Y) and has \A\ \B\ elements. 
It is clear that A\it(K n ) = S n . 

Also, A\it(Ki >n ) = Ei + S n = S n , where E\ is the trivial group. 

Consider the graph K 4 minus an edge, where V = {1,2,3,4} and the 
edge removed from K A is {2,4} say. Then A = {(1,3), (2,4), (1,3)(2,4), 1}, 
and so A = S 2 + 5*2. 

Example 3. The octahedron graph. Let T be the octahedron graph 
obtained from the solid which is the convex hull of the six points (in 3- 
dimensional space) V = {(±1, 0, 0), (0, ±1, 0), (0, 0, ±1)}. Then, the comple- 
ment graph of the octahedron graph is 3K2- Also, a graph and its complement 
have the same automorphism group (this is because every automorphism pre- 
serves adjacency as well as non-adjacency). It is easy to see that the number 
of automorphisms of 3K 2 is 2 3 3! = 48 since every automorphism can move 
vertices from one edge to another (and there are 3! ways to permute the 
edges) and on each edge, one can either switch the vertices on that edge or 
leave them fixed (2 ways for each edge, yielding another 2 3 automorphisms). 
Thus, | Aut(r)| =48. | 

Note that the number of rigid motions of the octahedron is exactly 24. 
The transposition that just swaps two nonadjacent vertices of the octahedron 
graph is an automorphism of the octahedron graph but not a rigid motion 
of the solid. This is unlike in the case of the n-cycle, for which the group of 
rigid motions of the regular n-sided polygon and the group of automorphisms 
of the n-cycle graph are the same. 

Definition 4. The wreath product (or composition) A[B] of "A around B" 
acts on X x Y. Suppose \X\ = d. Then, every 7r e A[B] can be written as 

7T = (a; (3 d ), and (a; ft, . . . , pd)(x» Vj) = (a^,ft%)- 
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The following result is due to Frucht: 

Lemma 5. [6] The automorphism group of n disjoint copies of a graph T is 
Aut(nr) = 5 n [Aut(r)]. 

It can be seen why Frucht's theorem is true, as we did above for the 
special case 3K 2 . In this special case, label the two vertices on the ith edge 
as (xi,yi) and (xj,y 2 ), for i = 1,2,3, and we can see that a G S 3 permutes 
the three edges (i.e. the £j's), and /3j G S 2 (for i = 1,2,3) acts on the z-th 
edge (i.e. it permutes the yiS). So Aut(3A 2 ) = S3 [S 2 ] ■ 

Theorem 6. The full automorphism group of the Petersen graph is isomor- 
phic to S 5 . 

Proof: Let T be the Petersen graph. Thus, its vertices are the 2-element 
subsets of {1,2,3,4,5}, with two vertices A and B adjacent iff they are 
disjoint. We write ij for the vertex {i,j}- 

Every element tt G S5 induces a permutation of the 2-element subsets 
of {1,...,5}, i.e. induces a permutation n of T. For example, if 7r = 
(1,3,4)(2,5) G S 5 , then 7T sends {1,2} to {3, 5}, and 7T = (12,35,42,15,32,45) 
(13, 34, 41)(25) G Sym(y). Furthermore, it is easy to see that different ele- 
ments of S5 induce distinct permutations of V. And each of these induced 
permutations is an automorphism of T because for all 7r G S5, A,B G V 
are disjoint if and only if tt(A) and tt{B) are disjoint. Thus, the map 
: S 5 — > V, n 1— > tt is an injective group homomorphism into Aut(r), and so 

s 5 = 0(s 5 ) < Aut(r). 

We now show that 0(S 5 ) is the full automorphism group of T. It suffices 
to show that A < 0(Ss). To prove this, let it G A. We show that there exists 
g G 4>{S^) such that irg — 1. This would imply that n = g^ 1 G </>(Ss). 

Suppose 7r : {1,2} — > {a, b}. Let g 1 G S 5 map a M- 1, b i->- 2. Then 
7r^! fixes the vertex 12 and hence permutes its neighbors 34, 45 and 35. We 
consider a few cases: 

Case (1) Suppose ngi fixes all three neighbors 34, 45, 35. So ngi permutes 
the neighbors of 35, and hence fixes 14 and 24, or swaps 14 and 24. 

Case (1.1): If ttc/i '■ 14 t— > 14, then 15 is sent to a vertex adjacent to 34 
and not adjacent to 14, hence 15 is fixed. Similarly, all the other vertices are 
seen to be fixed, and so ngi = 1, as was to be shown. 

Case (1.2): If irgi : 14 1— > 24. Then, it swaps 14 and 24. 15 is sent to a 
neighbor of 24 71 ^ 1 = 14, and hence 15 is sent to 25. Thus, we see that ngi 
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swaps 14 and 24, 15 and 25, and also 13 and 23, and fixes the remaining 
vertices. But then ng 1 = g 2 , where g 2 = (1,2). So n G 4>{S 5 ). 

Case (2): Suppose ngi fixes exactly 2 of the 3 vertices 34, 45 and 35. But 
this case is not possible, because if it fixes 2 of the 3 vertices, it must also fix 
the third vertex. 

Case (3): Suppose ngi fixes exactly 1 of 34, 45 and 35, say 34. So ngi 
swaps 45 and 35. Let g 2 = (3,4). Then ngig 2 satisfies the conditions of Case 

(I)- 

Case (4): Suppose ngi fixes none of 34, 45 and 35. Say it has (34, 45, 35) 
as a 3-cycle. Let g 2 = (3,4). Then Trg\g 2 = (34, 35) (45), and we are back to 
Case (3). 

Thus, in all cases if ir G A, then there exists gi, ■ ■ ■ ,g r (for some nonneg- 
ative integer r) such that ng\ . . .g r — 1, implying that n G 0(5*5). | 

The family of the generalized Kneser graphs J(n, k, i) is defined as follows. 
The vertex set of J(n, k, i) is the set of /c-element subsets of {1, . . . , n}, and 
two subsets are adjacent iff their intersection has size i. Biggs p] defines the 
family of Odd graphs Ok to be J (2k — 1, k — 1,0), a special case of which is 
the Petersen graph O3. Thus, the Petersen graph is J(5, 2, 0) and hence is 
isomorphic to the complement of the line graph of K5. It is an open problem 
to determine the automorphism group of J(n, k, i) for many special cases of 
these three parameters. We now give another proof (based on [17]) for the 
automorphism group of the Petersen graph. 

Second proof: The automorphism group of the Petersen graph is isomorphic 
to the automorphism group of the complement of the Petersen graph, which 
is L(K§). Thus, it suffices to find KvX(L(K^)). Every automorphism of 
K 5 induces a unique automorphism of L(K 5 ), as we saw above. We now 
show that each automorphism of L(K 5 ) induce a unique permutation in S$, 
implying that Aut(L(i^ 5 )) has at most 120 elements. 

Let 7r G Aut(L(i^ 5 )). Since L(K 5 ) is a line graph, its 4-cliques correspond 
to stars K 14: in K 5 . Thus, L(K 5 ) has exactly 5 4-cliques, say Ci,...,C 5 , 
where Cj contains the 4 vertices in L(K$) corresponding to the 4 edges in K 5 
that are incident to vertex i in K 5 . Since it is an automorphism, it sends 4- 
cliques to 4-cliques. Also, n induces a permutation of the Cj's, for if n sends 
two different cliques to the same clique, then 7r is not a bijection on the 
edge set of L(K^), which is a contradiction. Also, distinct automorphisms of 
L(K 5 ) induce distinct permutations of the Cj's. (For if we have two distinct 
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automorphisms, say 7r : 12 i — >■ 34, ir' : 12 h-> 35, then {CijC^} is mapped 
to {C3,C 4 } by 7r and to {C3,C 5 } by tc'.) Equivalently, every vertex ij in 
L(Ks) is uniquely determined by the intersection of two 4-cliques (namely 
the cliques Cj and Cj). Thus, every automorphism of L(K 5 ) induces a unique 
permutation of {C%, . . . , C5}. | 

Example 7. Hypercubes. The hypercube graph Q n has vertex set V = 
{0, l} n , and two vertices are adjacent in this graph iff the two n-bit strings 
differ in exactly one coordinate. Let r z : V — > V, x 1— > x+z be the translation 
by z. Here, x + z is the vertex obtained by adding the two bit strings x and 
z componentwise in the binary field. Then, H := {r z : z G V} can be seen 
to be a group of automorphisms of Q n , and \H\ = 2 n . Also, let K be the 
group of permutations of the vertex set induced by the permutation of the 
n coordinates of the bit strings. Then K fixes 00 ... 0, and \K\ = n\. Also, 
HC\K is trivial, and so \HK\ = \H\ \K\J \HC\K\ = 2 n n\. It can be shown that 
\A\ < 2 n n\, so that HK is the full automorphism group. To show \A\< 2 n n\, 
note that any automorphism that fixes the vertex 00 ... and each of its 
neighbors in Q n also fixes all the remaining vertices. Thus, \A e \ < n\, where 
A e is set of the automorphisms that fix the vertex e = 00 ... 0. By the orbit- 
stabilizer lemma, \A\ = \A e \\V\, and we get the desired bound. It is shown 
in [12] that Aut(Q n ) is isomorphic to the wreath product S n [S2\ - 1 

In algebraic graph theory, open-source software packages such as GAP 
and SAGE can be helpful with suggesting or testing conjectures. For exam- 
ple, an open problem is to determine the diameter of the modified-bubble 
sort graph MBS(n) (cf. [15]), and it can be confirmed with the help of a 
computer that for n = 3, . . . , 10, the diameter of MBS{n) is equal to \n 2 /A\ . 
(When the sequence of values obtained using the computer is entered into the 
Online Encyclopedia of Integer Sequences, this formula is displayed; this for- 
mula is also mentioned in [13]). No proof of this formula for all n is available 
in the literature. 

2 Cayley graphs generated by transposition 

sets 

A very promising area of research is Cayley graphs generated by transposition 
sets. I shall now mention some results related to the automorphism groups 
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of these families of graphs. 

Let G be a group and S a subset of G. The Cayley digraph (also known as 
the Cayley diagram [3]) of G with respect to S, denoted by Cay(G, S), is the 
digraph with vertex set G and with an arc from g to sg whenever g G G and 
s G S. When S is closed under inverses (i.e. when S 1-1 := : s G S} = S), 
(g, h) is an arc of the Cayley digraph if and only if (h, g) is an arc, and so we 
can identify the two arcs (g, h) and (h,g) with the undirected edge {g, h}. 
When 1 ^ S, the digraph contains no self- loops. Thus, when 1 £ S = S^ 1 , we 
view the Cayley graph Cay(G, S) as a simple, undirected graph. Cay(G, S) 
is connected if and only if S generates G. 

For a group G, define the map of right translation by z, r z : G — > G, g i— > 
gz. The right regular representation of G is the permutation group R(G) := 
{r z : z G G}, and R(G) is isomorphic to G. The automorphism group of 
a Cayley graph T := Cay(G, S) contains the right regular representation 
R(G), and hence all Cayley graphs are vertex-transitive (cf. [T]). Since R(G) 
is regular, Aut(r) = Aut(T) e R(G), where Aut(r) e is the stabilizer of e in 
Aut(r). The set of automorphisms of the group G that fix S setwise, denoted 
by Aut(G, S) := {tt G Aut(G) : S 71 = S}, is a subgroup of Aut(r) e (cf. [I]). 
For any Cayley graph T := Cay(G,S), the normalizer AA u t(r)-R(G ! ) is equal 
to R(G) x Aut(G,S) (cf. [9]), where x denotes the semidirect product (cf. 
[1]). A Cayley graph T := Cay(G, S) is said to be normal if R(G) is a normal 
subgroup of Aut(r), or equivalently, if Aut(r) = R(G) x Aut(G, S). 

Let 5 be a set of transpositions in 5" n . The transposition graph T(S) 
of S is defined to be the graph with vertex set {1,2,..., n} and with {i, j} 
an edge of T(S) whenever G S. A set of transpositions of {1, . . . , n} 

generates S n if and only if the transposition graph T(S) is connected, and a 
set of transpositions is a minimal generating set for S n if and only if T(S) is 
a tree (cf. [ID])- A set of transpositions whose transposition graph is a tree is 
called a transposition tree. Cayley graphs of permutation groups generated 
by transposition sets have been well studied, especially for consideration as 
the topology of interconnection networks [16], [T3] . 

Some particular families of Cayley graphs Cay (Gr (S), S) are defined as 
follows: 

• If T(S) = Ki >n -i, then Cay(S' n , S) is called the star graph. 

• If T(S) = P n , then Cay(S' n , S) is called the bubble-sort graph. 

• If T(S) = C n , then Cay(5' n , S) is called the modified bubble-sort graph. 
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If T(S) = nK 2 , then Cay (Gr(S), S) is the hypercube. 



• If T(S) = K n , then Cay(S n , S) is the complete transposition graph. 

• If T(S) = Kk, n -k, then Cay(S n , S) is the generalized star graph. 

We now mention some results, for which the proofs can be found in the 
given references. 

Lemma 8. UPf Let S be a set of transpositions of {l,...,n}. Then, S 
generates S n if and only if the transposition graph T(S) is connected. 

If 7r G S n is a permutation and % and j lie in different cycles of it, then 
the number of cycles in the product of ir and (i,j) is exactly one less than 
the number of cycles in n (cf. [2J). It can be shown that a product of n — 1 
transpositions is an n-cycle if and only if the corresponding n — 1 edges form 
a tree in the transposition graph. 

Lemma 9. IW] Let S be a set of transpositions of {1, . . . ,n}. Then the 
following statements are equivalent: 

(1) S is a minimal generating set for S n 

(2) T(S) is a tree 

(3) The product of the elements of S in any order is a cycle of length n. 

Lemma 10. JTflt Lemma 3.10.3] Let S be a set of transpositions such that the 
transposition graph T(S) does not contain a triangle, and let t,k G S . Then, 
tk = kt if and only if there is a unique J^-cycle in Cay(S' n , S) containing e,t 
and k. 

Among the Cayley graphs of the symmetric group generated by a set of 
transpositions of {1, . . . , n}, the automorphism groups of the following Cayley 
graphs are known. When T(S) is a star, the corresponding Cayley graph 
is called a star graph and has automorphism group S n -iR(S n ) [H]. The 
Cayley graph generated by a path graph is called a bubble-sort graph and 
has automorphism group isomorphic to Z 2 R(S n ) [TS]. The automorphism 
group of the Cayley graph generated by an asymmetric transposition tree is 
R(S n ) and hence is isomorphic to [10J. The automorphism group of the 
Cayley graph Cay(5' n , S) generated by an arbitrary transposition tree T(S) 
is shown in |5j to be isomorphic to R(S n ) x Aut(S n , S). All these Cayley 
graphs are also known to be normal. 
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Theorem 11. |5]/ Let S be a set of transpositions generating S n . Then, 
Aut(S n ,S) = Aut(T(S)). 

Theorem 12. J5^ Corollary 2.5] Let S be a set of transpositions generat- 
ing S n satisfying the following condition for any two distinct transpositions 
t,k G S : tk = kt if and only if C&y(S n , S) has a unique J^-cycle containing 
e,t and k, and if tk ^ kt then Cay(5 , „, S) has a unique 6-cycle containing 
e,t, k and a vertex at distance 3 from e. Then C&y(S n , S) is normal and has 
automorphism group isomorphic to R(S n ) x Aut(S' n ,5'). 

The modified bubble-sort graph MBS(n) is the Cayley graph of S n with 
respect to the set S of cyclically adjacent transpositions {(1, 2), (2, 3), ... , (n, 1)}. 
Thus, T(S) = C n in this case. 

The results that were mentioned above on the automorphism groups of 
Cayley graphs generated by transposition graphs that are particular trees, 
asymmetric trees, and arbitrary trees have been generalized in [7] to arbitrary 
transposition graphs that are connected and do not contain triangles or 4- 
cycles: 

Theorem 13. /?/ Let MBS(n) := C&y(S n , S) be the modified bubble-sort 
graph. Let t, k G S. If tk ^ kt, then the modified bubble-sort graph MBS(4) 
does not contain a unique 6-cycle passing through e,t, k and a vertex at dis- 
tance 3 from e, and MBS(n) does contain a unique 6-cycle passing through 
e, t, k and a vertex at distance 3 from e for all n > 5. 

Lemma 14. [7|/ If Sj, Si + \ G S are two adjacent transpositions in T(S) = C4, 
then there are exactly eight distinct 6-cycles in MBS(4) that contain e, Sj, 
and a vertex at distance 3 from e. The total number of vertices in 6-cycles 
of MBS(4) that contain e, Si and Si + i and that are at distance 3 from e is 
exactly 6. 

Theorem 15. The automorphism group of the modified bubble-sort graph 
MBS(n) is isomorphic to D 2n V4 : R(S n ) , if n = A, and is isomorphic to 
D2 n R{S n ), if n > 5. Here, D2 n is the dihedral group of order 2n, V4 is 
the Klein four-group, and R(S n ) is the right regular representation of S n . 

Theorem 16. [1] The modified bubble-sort graph MBSin) is not normal if 
n = 4 and is normal if n > 5. 
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Theorem 17. fW Let S be a set of transpositions generating S n , let T(S) 
denote the transposition graph, and let T := Cay(S n , S). Let k,t G S be 
distinct transpositions. If tk ^ kt and T(S) does not contain triangles or 
4-cycles, then there is a unique 6-cycle in Y containing e,t,k and a vertex 
at distance 3 from e. Moreover, ifT(S) does contain a triangle or a 4-cycle, 
then there exist t,k G S such that tk 7^ kt and such that there does not exist 
a unique 6-cycle in F containing e, t, k and a vertex at distance 3 from e. 

Theorem 18. [7j/ Let S be a set of transpositions generating S n such that 
the transposition graph T(S) does not contain triangles or ^-cycles. Then, 
Cay(5' n , S) is normal and has automorphism group isomorphic to R(S n ) x 
Aut(5 n ,5). 

We summarize these results on the automorphism group A := Aut(Cay(S , „, S)) 
as follows: 

• If T(S) is a star, A S S n ^R(S n ) [HI 

• If T(S) is a path, A = Z 2 R(S n ) |H] 

• If T(S) is an asymmetric tree, A = S n [10J 

• If T(S) is a tree, A = R(S n ) x Aut(5 n , S) 

• If T(S) is an n-cycle, A = D 2n VR(S n ) if n = 4 and A = D 2n R(S n ) if 
n > 5 [7J 

• If T(S) is connected and does not contain triangles or 4-cycles, then 
A = R(S n ) x Aut(S n ,S) [7] 

3 Other graph invariants 

A very promising area of research is Cayley graphs generated by transposition 
sets, as was mentioned earlier. Besides the automorphism group, other prop- 
erties of interest are: diameter, vertex connectivity, fault tolerance, indices of 
routings, diameter vulnerability, and distributed routing algorithms, among 
others. See [8] and the references therein for open problems and questions 
on the diameter of these families of Cayley graphs; see also the survey arti- 
cles [16], [13]. Many of these problems have applications in interconnection 
networks. 
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The rich theory of hypercubes can be generalized to or investigated for 
other Cayley graphs. For example, when the transposition graph T(S) be- 
longs to a particular family of graphs - say trees, complete bipartite graphs, 
n disjoint copies of some simple graph, cycles, etc - much remains to be 
investigated. 
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